Evaluating the Rate-Distortion Function of Sources with Feed-Forward and the Capacity of Channels with Feedback
نویسندگان
چکیده
We study the problem of computing the rate-distortion function of sources with feed-forward and the capacity of channels with feedback. The formulas (involving directed information) for the optimal feed-forward rate-distortion function and the feedback channel capacity are multi-letter expressions and cannot be computed easily in general. In this work, we derive conditions under which these can be computed for a large class of sources (channels) with memory and distortion (cost) measures and provide illustrative examples. Accompanying the results above, we also present an interpretation of the information quantities characterizing the performance limits of the delayed feedback/feed-forward problems. This interpretation can be used to obtain capacity/rate-distortion expressions for certain related problems as well. We illustrate this by extending our results to problems where there is some delayed side-information available to both the encoder and decoder, in addition to the feedback or feed-forward.
منابع مشابه
Feed-Forward Rate Distortion Function and Markov Sources
The problem of channel coding with feedback has been extensively studied over the last 50 years. Using an ideal feedback link, the encoder knows all previously received channel outputs. Recently the duality between channel coding and rate distortion has been established in [15] and [3], leading to the problem of source coding with feed-forward. In this project we first study the general formula...
متن کاملProgressive Joint Source-Channel Coding in Feedback Channels
It is well known that Shannon's separation result does not hold under nite computation or nite delay constraints, thus joint source-channel coding is of great interest for practical reasons. For progressive source-channel coding systems, eecient codes have been proposed for feed forward channels 1] and the important problem of rate allocation between the source and channel codes has been solved...
متن کاملEvaluating the Evaluator: Towards understanding Feed-back, Feed-up, and Feed-forward of Moroccan Doctorate Supervisors’ Reports
Supervisor’s feedback is both a naysaying and a puzzling concern that has always tormented academics in higher education. Particularly, written feedback on pre-final or final versions of a submitted doctoral dissertation is indisputably the most significant step toward granting a doctoral student supervisee the right to defend his/her research project. It also constitutes a rich source on how s...
متن کاملThe capacity-cost function of discrete additive noise channels with and without feedback
We consider moduloadditive noise channels, where the noise process is a stationary irreducible and aperiodic Markov chain of order . We begin by investigating the capacity-cost function ( ( )) of such additive-noise channels without feedback. We establish a tight upper bound to ( ( )) which holds for general (not necessarily Markovian) stationary -ary noise processes. This bound constitutes the...
متن کاملThe Reliability Function of Lossy Source-Channel Coding of Variable-Length Codes with Feedback
We consider transmission of discrete memoryless sources (DMSes) across discrete memoryless channels (DMCs) using variable-length lossy source-channel codes with feedback. The reliability function (optimum error exponent) is shown to be equal to max{0, B(1−R(D)/C)}, where R(D) is the rate-distortion function of the source, B is the maximum relative entropy between output distributions of the DMC...
متن کامل